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Field of the Invention 
The invention relates to digital signal processing, and more particularly, to 
an adaptive filter that suppresses residual echo in the sent path of an echo canceller. 

Background Art 

* In a hands-free telephone, the far end acoustic signal can cause undesired 
feedback. This feedback can be neutralized by an appropriate echo suppression 
device. One such device, known as an acoustic echo canceller allows full duplex 
communication, but it requires significant computational resources and may not 
always provide enough echo attenuation. For example, under optimal conditions 
an acoustic echo canceller may provide a maximum echo reduction of 25 to 30 dB, 
whereas an optimal hands-free telephone conversation needs the echo level to be 
reduced by 40 to 45 dB. Therefore, acoustical echo cancellers in telecommunication 
devices are typically complemented with a so-called post-processor. 

EigureJ. shows a generic echo canceller arrangement with such a post- 
processor. The input signal d(k) is a combination of acoustical echo y(k), local 
speech s(k), and background noise n(k) : 

d(k)=y{k)+s{k) + n(k) (1) 
The echo cancelled residue e(k), in Fig. 1, is composed of a residual echo tfk), the 
local speech signal s(k), and the background noise n(k), where e (k)~ y{k)- y{k). The 
post-processor further suppresses the residual echo level after the echo canceller. 
This is commonly realized by a non-linear action, such as loss insertion, center 
clipping, etc. That typically means attenuating the signal at the output of the echo 
canceller. But, together with the residual echo level, the other signal components at 
the output of post-processor are also attenuated. 

To avoid attenuating the local speech signal in the send path of the echo 
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canceller, the operation of the post-processor may be controlled by a "voice activity 
detector" (VAD) that attempts to determine whether the local speaker is active or 
not. In the former case, the post-processor is not used and the echo residue is 
assumed to be masked by the local speech. In the latter case, the post-processor 

5 suppresses the residual echo to an acceptable low level. But, VAD-controlled post- 
processors are difficult to control, and give rise to artefacts such as chopping and 
clipping of local speech. Also, the noise component n(k) is not taken into account in 
the on/off decision of the post-processor, so the performance of such post- 
processors in noisy circumstances is rather poor — during local speech, the 

10 background noise passes through without attenuation; when the local speaker is 
not active, the background noise is suddenly shut off because it is suppressed along 
with the residual echo. 

An echo shaping technique was suggested by R. Martin and S. Gustafsson in 
An Improved Echo Shaping Algorithm for Acoustic Echo Control, Proceedings of 

15 European Signal Processing Conference-96, pp. 25-28, September 11-13, Trieste, 
Italy, 1996, (hereinafter, "Martin and Gustafsson"), the contents of which are 
incorporated herein by reference. Martin and Gustafsson suggest using an adaptive 
echo shaping filter placed in the echo canceller send path for a post-processor. This 
creates a "soft decision directed" residual echo suppressor that does not exhibit the 

20 "on/ off" behavior found in classical residual echo suppressors. As a result, quality 
of speech (i.e. the observed distortions of local speech) has been found to be better 
than what can be achieved with classical post-processors. As an additional 
advantage, the proposed echo shaping filter may largely compensate for poor 
performance of the echo canceller. Therefore it has been suggested to design an 

25 echo controller having of a relatively low order echo canceller (typically, 20 
coefficients) followed by the echo shaping filter. 

Figure 2 presents a block diagram of an echo canceller EC combined with an 
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echo shaping filter H. The echo shaping technique employs two low order finite 
impulse response (FIR) filters: background filter Hi is an adaptive filter that is 
updated in the background, its contents are copied into the postfilter H, which filters 
the echo canceller EC residue e(k). The updates to back ground filter Hi have to be 

5 controlled so that frequencies of e(k) are attenuated only where the echo residue e(k) 
has more power than the local speech s(k). Thus, echo shaping filter H has to 
attenuate the echo residue e(k) at those frequencies where it is particularly audible, 
while at the same time the distortion of the local speech s(k) must be kept at an 
acceptable level. Therefore the key issue of the echo shaping technique is how the 

10 background filter Hi is updated. 

Background filter Hi is a low-order (typically 20 coefficients) FIR filter that is 
updated by adaptation following a normalized least-mean square (NLMS) 
algorithm. The reference signal z(k) of the background filter Hi is synthesized as a 
combination of the microphone signal d(k) and the echo canceller EC residue e(k) as 

15 follows: 


where oik) is a time varying non-negative control factor that is determined by an 
"adaptive control" mechanism. 

Since e(k) = d(k)- y(k), (2) can also be written as 


Thus by changing the control factor oik), the contribution of an estimate of the echo 
in the synthesized signal z(k) can be controlled. (In contrast to the echo canceller EC, 
since for the adaptation of the echo shaping filter H it is not important to dispose of 
an exact echo estimate in terms of amplitude and phase. Because of the adaptive 
25 control mechanism in the control factor oik) it is sufficient to have a rough idea of 
the energy in the echo.) When oik) = 0, z{k) = e(k) and the NLMS algorithm will 
adapt background filter Hi such that it changes into an all-pass filter. Thus, echo 


z{k) = a{k)d(k)+ (l - a{k))e{k), (2) 


20 


z(k) = e{k) + a{k)y{k) 


(3) 
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shaping filter H will have no influence on the echo canceller EC residue. This is the 
preferred case where only the local speaker is active, or where both speakers are 
active but the echo canceller EC has already achieved a significant reduction of the 
echo. By increasing the control factor oik), the relative contribution of the echo to 
z(k) is increased. This also implies that the relative contribution of the echo is 
increased in the background filter error signal eh(k). Since the NLMS algorithm will 
adapt the background filter Hi so that it attempts to strongly attenuate this error 
contribution, echo shaping filter H also will strongly attenuate the residual echo in 
e(k). 

Clearly, a key aspect is the control algorithm for the control factor a(k). 
During single far talk, oik) should be as high as possible, whereas when only the 
local speaker is active, it should be close to zero. During double talk, an appropriate 
value for oik) must be used so that attenuation of the local speech is avoided while 
at the same time the echo residue is attenuated at frequencies where it is not 
masked by local speech. 

Martin and Gustafsson proposed two control algorithms for the control 
factor oik). The first one, which will be referred to as MG1, was designed to 
explicitly account for the degree of echo attenuation already achieved by the echo 
canceller EC in order to avoid unnecessary local speech level modulations. It turned 
out, however, that this MG1 control algorithm is very sensitive to estimation errors. 
That is because good estimates of the echo attenuation achieved by the echo 
canceller EC are not easily obtained — especially during double talk. Therefore, the 
MG1 algorithm is not practically relevant. 

The second control algorithm, which will be referred to as MG2, calculates 
the control factor dk) as the ratio of the momentarily power of the estimated echo 
and the momentarily power of the echo canceller EC residue. While this algorithm 
is very simple to implement, it has an important drawback; that is that oik) tends to 
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fluctuate very strongly and in a large range (> le5). Theoretically, the control factor 
a(k) is only limited to being non-negative, so at first sight this does not seem to be 
very constraining. However, in practice it has been observed that an upper limit 
should be placed on a(k) for reasons of stability. Furthermore, due to the large 

5 fluctuations in the contributions to z(k), hence eh(k), the NLMS algorithm has to 
"work very hard" to update background filter Hi to the continually changing 
conditions. Although the background filter Hi is rather short, it has been observed 
that the NLMS algorithm must be run with a rather large convergence coefficient in 
order to achieve the necessary convergence speed. This also gives rise to a lot of 

10 instabilities. Finally, the proposed MG2 control algorithm tends to be fairly 

aggressive, and often attenuates low-level local speech (e.g. it chops soft speech 
onsets, etc.). Another consequence of being so aggressive is that the MG2 algorithm 
doesn't work well in the presence of significant background noise where it gives 
rise to annoying modulations similar in character to the switching modulations of a 

15 classical suppressor. 

Thus, the problem with the MG2 algorithm is that it can be far too 
aggressive. This can be illustrated by plotting the attenuation characteristic of the 
echo shaping filter using different control algorithms, and for different levels of 
echo cancellation (the so-called ERLE — echo return loss enhancement ) achieved by 

20 the echo canceller EC. 

Figure 3 presents the attenuation characteristic of the echo shaping filter H 
for control algorithm MG1. The attenuation characteristic has been plotted as a 
function of the parameter pioo), where p(co) denotes the ratio of the local speech plus 
background noise to the echo: 


where R ss ( co) is the auto-power spectral density of the local speech signal, etc. As 


25 


p(co) 


_ R ss {co) + R nn {a>) 



(4) 
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shown in Figure 3, the MG1 algorithm realizes a near-to-optimal behavior, that as 
soon as the local speech (plus background noise) level is lower than the echo level 
{i.e. p(co) < 1), the attenuation achieved by the echo shaping filter H increases. This 
compensates for the fact that in such a case the local speech would not efficiently 
5 mask the residual echo. Also, the lower the ERLE, the more attenuation is achieved 
by the echo shaping filter H, thus compensating for the shortcomings of the echo 
canceller EC. Unfortunately, as discussed above, it is not possible to achieve the 
predicted behavior for the MG1 algorithm in practice. 


rather brute force solution that gives rise to very high attenuation in many 
conditions. Also, the attenuation curves start to rise when p(co) > 1, showing why 
low level local speech is sometimes chopped as well. Moreover, the attenuation 
achieved by the echo shaping filter H increases together with increasing ERLE which 
15 is rather undesirable. NOTE: The attenuation characteristic presented in Figure 
does not resemble the one presented by Martin and Gustafsson, which, however, 
has been found to be incorrect. Therefore some of the conclusions drawn by Martin 
and Gustafsson with respect to the MG2 algorithm are not correct either. 


20 have been observed: (1) the proposed algorithm was not always stable, and (2) the 
proposed algorithm still gives rise to annoying noise modulations. In order to cope 
with (2), Martin and Gardner proposed using a comfort noise generator (CNG). The 
CNG is run at the output of the post-processor, and adds noise to the post- 
processor output during local speech pauses so that the observed background noise 

25 level (and ideally, the noise spectrum) is the same during both local speech and 
local speech pauses. This approach has the drawbacks that the complexity of .the 
combined echo shaping filter and CNG increases (especially if the background 



Thus, two deficiencies of the Martin and Gustafsson echo shaping approach 
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noise is synthesized accurately), and the operation of the CNG is again VAD-driven 
so that artefacts (due to mistakes made by the VAD) must — again — be anticipated. 

Summary of the Invention 
A representative embodiment of the present invention includes an 
improved echo control system and method having an echo-containing near signal 
input. An echo canceller is coupled to a far signal reference and produces an echo 
estimate signal output representative of the echo contained in the near signal. A 
signal coupling node is coupled to the near signal input and the echo estimate 
signal output, and produces an echo-canceled signal output having an echo residue. 
An echo shaping filter is coupled to the echo-canceled signal output, and reduces 
the echo residue and provides an echo-suppressed signal output. The echo shaping 
filter has a spectral response determined by filter coefficients. A background filter 
is coupled to: (a) an error signal representative of the difference between: (i) the 
echo canceled signal, and (ii) a signal representative of background filter spectral 
response, and (b) an adaptive control module producing a reference signal output 
that is a weighted sum of: (i) the echo-containing signal, and (ii) the echo canceled 
signal. The background filter updates the filter coefficients of the echo shaping 
filter responsive to a normalized least mean square (NLMS) algorithm. The 
improvement includes determining, in the adaptive control module, a reference 
signal weight for the weighted sum, the weight being proportional to the far signal 
reference; and an estimate of the norm of an echo canceller error vector, and 
inversely proportional to ftn estimate of a residue of the echo canceller; and using a 
non-linear normalized convergence term in the NLMS algorithm. 

In a further embodiment, the echo canceller, the echo shaping filter, the 
background filter, or combination may be a finite impulse response (FIR) filter. 
The echo canceller error vector may be determined as: 
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Aw(*) = w^-w(*) 

where Aw(/c) represents the echo canceller error vector, w ep represents a physical 

echo path identified by the echo canceller, and w(k) the echo canceller response. 
The reference signal weight may be determined as: 

eA k ) 

where oik) represents the reference signal weight, /? represents a consta nt 
normalizing term, ||Aw(fc)|| repi^ents^m estimate of the norm of the echo canceller . 

error vector, x s (k) represents a short-term average magnitude of the far signal 

reference, and e s (k) represents a short-term average magnitude of the echo 

canceller residue. 

The echo canceller error vector may be determined as: 

-£k(*)| 


N + N T & 
N T 1=1 


The NLMS update algorithm may be: 

where h(k) represents the echo shaping filter having an order L H , z(/c) represents a 
vector representing the L H most recent values of the reference signal output, . 
e h (k) represents the error signal, £ represents a non-negative constant, and ' 

M . K«ul I V> 


represents a nor maliz ed cony^ge^e^oeffirient 


C + Z(k) T Z{k) r ^ J /V 

Brief Description of the Drawings 
The present invention will be more readily understood by reference to the 
following detailed description taken with the accompanying drawings, in which: 
Figure 1 shows a generic acoustic echo canceller with a post-processor. 


< — 


1585/A26 

Figure 2 shows an echo cancelling system with an adaptive filter echo 
canceller EC and an echo shaping filter H. 

Figure 3 shows the attenuation characteristic of the echo shaping filter H for 
the MG1 algorithm. 

5 Figure 4 shows the attenuation characteristic of the echo shaping filter H for 

the MG2 algorithm. 

Detailed Description of Specific Embodiments 
Representative embodiments of the present invention control the time 

10 varying control factor oik) in the adaptive NLMS algorithm of the background filter 
Hi so that both the ERLE achieved by the echo canceller EC and the low level local 
speech and noise contributions are explicitly taken into account. Unlike the MG2 
algorithm proposed in Martin and Gustafsson, the adaptation of the residual echo 
suppressing filter is governed both by a noise-level adaptive steering mechanism 

15 and by a data non-linearity. 

One advantage of adaptation to the noise level is that it allows the residual 
echo suppressing filter to be used in conditions with a high noise level. Suppression 
of residual echo under these conditions would normally give rise to annoying noise 
modulation artefacts, hence necessitating the operation of a Comfort Noise 

20 Generator (CNG) at the output of the residual echo suppressing filter. The post- 
processor of representative embodiments obviates the need for a CNG by 
controlling the updates to the adaptive echo shaping filter so that it tends towards 
an all-pass filter in noisy conditions. This avoids noise modulations and makes 
efficient use of the fact that the high background noise masks the residual echo at 

25 the output of the echo canceller. The data non-linearity optimally balances the 
stability of the adaptation on the one hand, and the achieved residual echo 
suppression when using the noise-level adaptive steering mechanism on the other 
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One specific embodiment calculates the control factor oik) as: 

e s \ k ) 

where x s (k) is the short-term average magnitude of the reference signal of the echo 

5 canceller EC, e s (k) is the short-term average magnitude of the echo canceller EC 

residue, |Aw(fc)|| is an estimate of the norm of the error vector of the echo canceller 

adaptive filter, and P is a constant term which can be used to normalize the 
equation somewhat. The error vector of the echo canceller adaptive filter may then 
be defined as: 
10 Aw(k) = w ep -w(k) 

where w ep is the impulse response of the physical echo path that must be identified 

by the echo canceller EC, and w(k) is the echo canceller adaptive filter. 

A relatively good estimator for the norm of the error vector of the echo 
canceller adaptive filter can be constructed by delaying the received signal a known 
15 number of samples Nt back in time, and extending the echo canceller adaptive filter 
by the same number of coefficients. This will cause the adaptive filter to have at 
least Nt coefficients, which ideally should be zero. A good estimate for the filter 
error is then given by: 

20 Using the above algorithm to control the control factor a(k) has several 

advantages: 

1. The control factor oik) will be large as long as the echo canceller EC has not 
converged to the optimal solution. 

2. If there is no background noise and the local speaker is not active, the echo 
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canceller EC residue is purely residual echo, thus the control factor a(k) will be 
large and the residual echo is strongly attenuated. 

3. On the other hand, the control factor a(k) will be reduced as soon as the level of 
the echo canceller EC residue exceeds the level of the echo canceller EC 
reference signal (the far end signal) weighted by the filter error norm. As soon as 
the latter weighting factor is relatively small (i.e. the echo canceller EC has 
converged), low-level contributions to the echo canceller EC residue also will 
decrease the control factor oik), and therefore these contributions will not be 
attenuated by the echo shaping filter. 

4. The used estimators are based on signal amplitudes rather than signal power, 
thus limiting the dynamic range of the internal variables and facilitating 
implementation on fixed-point processors. 

The implementation of this control algorithm for the control factor oik) 
requires a lot of information from the echo canceller EC. With this approach the 
echo canceller EC and the echo shaping filter H become a tightly connected 
combined system for echo suppression. 

In practice, representative embodiments greatly reduce artefacts such as local 
speech attenuation and background noise modulations, and at the same time, 
attenuation of the residual echo during single far talk is reduced as well. That is 
because the value of the control factor o(k) still fluctuates quite strongly in time. 
This explains a basic difference between representative embodiments and the MG2 
algorithm. In both cases, the NLMS algorithm is not able to continuously track the 
fluctuating error signal en(k) and thus a kind of "average " echo shaping filter is 
obtained. In the case of the MG2 algorithm, this "averaging " process in the updates 
of the echo shaping filter H is dominated by large values of the control factor dk). 
Therefore, the echo shaping filter H attenuates the echo canceller EC residue very 
strongly (including background noise and low-level local speech). In the case of the 
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new control algorithm, however, the average value of oik) is much smaller (around 
1). Consequently, the averaging process in the updates of the echo shaping filter H 
tends to yield a filter that does not sufficiently attenuate the echo canceller EC 
residue. 

At first sight, a simple solution would be to increase the convergence speed 
of the NLMS algorithm. With this, however, the stability margin of the algorithm 
strongly reduced, which is highly undesirable. Careful study of the behavior of the 
echo shaping filter H when its updates are controlled by (5), however, have shown 
that a modified update rule of the NLMS algorithm can solve this problem. 

As explained before, the control algorithm for oik) should bring o(k) close to 
zero when the local speaker is active. When oik) ~ 0, the echo shaping filter H will 
evolve to an all-pass filter, and the local speech will pass through almost 
unattenuated. With the new control algorithm (5), however, there are other 
occasions where oik) tends to zero. Specifically, oik) decreases whenever the level 
of the far end speech, estimated by x s {k), decreases. As this happens at the end of 
each word, this suggests that the echo shaping filter H is driven towards all-pass 
behavior at the end of each word uttered by the far end speaker, and that it has to 
re-converge to an attenuation filter during the next word. Because of the limitations 
on the convergence speed, the echo shaping filter H is never able to achieve a high 
attenuation. (When the far end signal is music, the signal level is relatively constant, 
and the value of oik) does not fluctuate so strongly. Thus, the conditions for 
updating the echo shaping filter H are also more stable and the achieved residual 
echo attenuation is larger.) 

Hence, the solution to this problem is to avoid updates to the echo shaping 
filter H when the decrease of the control factor oik) is not due to the activity of the 
local speaker. This can be achieved by modifying the NLMS update rule of the echo 
shaping filter. 
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The standard NLMS update rule is : 

h(* + 1) = h(fe)+ ? (*) (6) 

where h(fc) is the adaptive echo shaping filter of order Lh, z(fc) is a vector constituted 
of the Lh most recent z(k) values, calculated by (3), and en{k) is the error signal, as 
shown in Figure 2. 

To improve attenuation performance of the echo shaping filter, the following 
modified NLMS update rule is used: 

> " < "° h " l VHW t ) # '" ) <7> 

where £ is a non-negative constant. The main effect of adding this constant term in 
the NLMS update rule is that the normalized convergence coefficient ^ 


C + z{k) T z(k) 

no longer increases inversely proportional to the energy in the z(fc)-vector. On the 
contrary, whenever the energy in the z(k)-vector becomes very low, the NLMS- 
updates are slowed down when compared to the case without the constant term 
To understand why this helps the echo shaping filter H to achieve higher 
attenuation, it should be considered under what conditions the energy in the z(/c)- 
vector can become low. Recall that the signal z(k) is synthesized by adding e(k) and 
a(k)y(k) . Thus, if the local speaker is active, then the control factor a(k) will be low 
because of (5) but at the same time e(k) will have a high level. In this case, the 
energy in the z(/c)-vector is high, the effect of the constant term £ is negligible, the 
echo shaping filter H converges rapidly to an all-pass filter, and local speech is not 
attenuated. If the local speaker is not active, then the first term in z(k) is small. If, at 
the same time, the far end speaker is active, then the control factor oik) will be high. 
Thus again, the energy in the z(A:)-vector will be high and the echo shaping filter H 
starts to converge to the appropriate attenuation filter. If, however, the far end 
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speaker stops speaking, the energy in the z(/c)-vector will decrease. Where the 
standard NLMS update rule would compensate for this, the modified NLMS 
update rule shown in (7) will inhibit further updates to the echo shaping filter. 
Whenever the energy in the z(/c)-vector increases again, the echo shaping filter will 
again be updated. If the increase in energy in the z(/c)-vector is due to single far end 
speech, the echo shaping filter will further converge to the appropriate attenuation 
filter. 

For this strategy to work, an appropriate value needs to be selected for the 
constant term For too low a value, its effect is negligible, whereas too high a 
value will continuously slow down the NLMS-adaptation. However, "too high" 
and "too low" must be related to the actual levels of the input signals of the echo 
canceller EC (and the post-processor). As these levels may be different per specific 
case, an optimal setting for £ in one setting may not be optimal for another specific 
case. In practice, however, it has been observed that for a chosen value of the 
constant term all input signal levels may vary in a large range without affecting 
the functionality of the control algorithm of the echo shaping filter. 

With this modified NLMS update rule, two objectives can be realized: less 
modulations of background noise and low-level local speech, and high attenuation 
of single far end speech. 

Although various exemplary embodiments of the invention have been 
disclosed, it should be apparent to those skilled in the art that various changes and 
modifications can be made which will achieve some of the advantages of the 
invention without departing from the true scope of the invention. For example, 
alternative embodiments may be used to control the level of echo present in the 
input signal of an Interactive Voice Response application, thus improving the 
speech recognition performance of this application. 
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